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FROM FIG. 7 A 

__L 




If got to SOAnotherSet because said 
"no" to SOContinueRead, leave off 
the first sentence: 

To hear these directions again, 
say 'start over'. To get a new set of 
directions, say 'new directions'. Or 
name another BV service." 



FIG. 7B 



SUBSTITUTE SHEET (RULE 26) 



WO 01/26350 PCT/US00/26935 



SODirections 

Can be callec 
either from 
the main 
menu or as 
part of 
Business 
Finder. 



19/20 



Would you like to resume from 
;your most recent set directions?" 

yes .... 




Ad 
Server 



Standalone: "Just 
a minute while I look up 
those directions for you." 
With supplied dest: 
"Just a minute while I look up 
directions to <destination>." 

Conditional 
(Registered and 
hasn't emailed) 

Standalone: "It should 
take you about X 
minutes to drive this Y 
mile route. There are Z 
steps total." 
For BF: "It should take 
you about X minutes to 
drive this route. There 
are Z steps total." 



GetDirectidns- 
•-OnResume" 



"Okay, I have your 
directions. Where 
would you like to 
start?" 



•Would you 
like me to /' SO N 
read:' Direction \ 
directions' \ Delivery / . 
or email "Method - * 
directions'?" J 

IsReadCommand 



M Dirs I 

* mXm.mm 



-Mddrs.J.. 



...J 



v Steps v ' / 




~YTO FIG. 7B 




"Would you like me to 
read your directions 
from step 1 or from 
highway XT 



Conditional 
(Long route) 



FIG. 7 A 
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SOItinerary 



SO Itinerary 
v Init State 1 

HasntSaidButMight 
KnowAirline 

G10 



'SeT 
.AirlineToDont! 
-Know- 
Please say the 



18/20 

On entry, the objects setFlight method will 
have been called to establish parameters which 
have already been identified. (I.E. Arrival/ 
Departure and name of airline (if known) 

Do you know the Airline? 

Please say the airline. 
UnsupportedAir() 

saidYes() 



/ tCheck A 




V Airline J 


GJ1\ ir, ' ne / 



Set 
.Airline 



SO 
VirportCit 



Invokes 



don'tKnow 



departure city, (departure) SODisambiguateAirport 
QX3^^ object directly. 
Invokes 



p. ,.. /StT\ Invokes 

kXiS hJ? (WortCity) SODisambiguateAirport 
arrival city. \\ arrm ^y object directly. 

n. ia^-t^ P'ease say the arrival city. 




SkipConfirm 



G14 



What is the appximate 
r»/cl( S0F, '9 nt )) [ arr «va» I departure! time 
iris \\ T\m%yJ of the flight? 



OK, I'm going to look for a flight on 

SOItinerarv P^ 3 '^ a ' r,ine wnicn ?wl " f arrive 1 arrived 
' CandC J l 6e P? n 1 d epartedJ at about <time> <date> 
Ju / [, n | fromj <city>. Is this information correct? 

I 



change 
itinerary 



I found six flights that 
match your itinerary. 
Here's the first flight: < 



SetRighT 
.Schedule. 



GetPlayable 
J-ist 



SORead 
Routes 



G17 



GetFlighT 
Info 



\^-4ioFlights() 



Jravelocity 
DB 



-repeat/ start over/ 

previous/ ^main menu 
[The flight I <airline> flight # <flight#>] [is 
delayed and] {departed I will depart] <airport> 
[early I on time] at <time> [from gate <gate> 
(terminal <terminal] [has been cancelled] 



Note that this ( tNoFlight' 
getFlightlnfo will also V info 
have to set the 
appropriate leg number 
of the flight to vocalize. 



FIG. 6E 
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SOFiightlnfo 

Please say the airline and flight 
number. If you're not sure about 
either, just say "Won't know it. 



I also need to 
know the 
flight number 
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Please 
say the 
flight 
number. 




Please say 
the date. 



Tlightlnfd" 
Confirmlnif 



\G6 



GS 



Would you like to change the 
airline, flight number, date all 
of these, or none of these,. 

to SOAirline ^V-ChangeFlightMumO, 
tFlightNumber, or I J ChangeAirline(). 
SOAirlineFlight ChangeBoth() 

nolnfo() 



'SOFIight 

Info 
XandC 



OK, so you would like 
[departure I arrival] 
information about 
<airline> flight number 
<flight numbeo for 
today. Is this correct? 

saidYes() 



Get 
Flightlnfo 



I'm sorry, I couldn't find 
any flights that match the 
information you, 
gave me. 



Independent 
^Flight Info 
^database 



No 
Tlightlnfo 



multipleLegsO 



Would 
you like to 
search for G7, 
another 

,li9M Wch' 
Another 
Flight 



saidYesO' 



The flight requested 
make multiple stops. 
Would you like [arrival I 
departure] information 
for <city>, <city>, or 
<city>, or [all I both] of 
Jhese? 



SO 
Choose 
Leg 



.G8, 




-SaidStopO ( SOFIight 
1 Status 



G9 



Flight 
Statuslni 

returns a flight object 
including XML doc 

[The flight I <airline> flight # 
<flight#>] [is delayed and] 
[departed I will depart] 
<airport> [early I on time] at 
1 <time> [from gate <gate> 
[terminal <terminal>] [has 
been cancelled]. 



EndState 
AnotherFlight 



EndState 
MainMenu 



FIG. 6D 



this example assumes departure. 
Similar format for arrival. 
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SOFIightFinder 
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Welcome to 
Travelocity Flight 
information Finder, 
brought to you by 
BeVocal. 



Would you 
like arrival or 
departure 
information? 



I'm sorry, flight 
information is 
unavailable at this 
time. Please try 
again later. 



ano 




FIG. 6C 



RIIRRTmnr cucrr mi n e ic\ 
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IsMoreThanOneCounty? 




SOAddressDisambiguateAndConfirm 



"Did you Mountain View 
in Santa Clara county or 
Alameda county?" 



"Santa Clara. Is 
this correct?" 



SOMetro 
OrCounty 
Disambiguate 
JCandC. 




'rocess 
Disambiguate' 



"Did you mean 'North Main 
Street', 'South Main Street' 
or 'None of these'?" 



"123 North Main Street, 
Mountain View, CA. Is 
this correct?" 



Would you like to correct the 
street number, street, cross 
street, everything or nothing? 

OR 

Would you like to correct the 
city, street, everything or 
nothing? 



Possible destination: 

1 . IsChangeStreet 

2. IsChangeCrossStreet 

3. IsChangeNumber 

4. IsChangeCity 

5. IsChangeEverything 

6. IsOK 




Needs disambiguation 
within city? 



"Do you want 
to change 
SECOND 
street?" 
(cross street) 



"Do you want 
to change 
FIRST street?" 
('the' street) 



FIG. SB 



SUBSTITUTE SHEET f RULE 26) 



WO 01/26350 

SOAddress 



PCT/US00/26935 



14/20 



Saved 
Address 



,F3 ""airport" 
r 'Name 
a street- 




Interesting errors: 

"Addresses are not available in Hawaii 
Puerto Rico, or Alaska." ' 
"Your HOME/WORK address is not in 
a supported state." 
"You must be logged in to use saved 
addresses." 



"home", "work", "last 
source", "last destination" 



For now, reuse 
the 

SOAirportCity 
object from 
Flifo, with 
M slightly 
fSOAirportj] different 
1 City J) prompts. Later, 
yy we'll need 
much more 
customi- 
zation. 



H!^ Supported -^Currently, 
^^AirportState-^^Ports 

^«s^ — Qra 



yes 



are 
available 
inCA, Ml, | 
and TX. 



no 



IsChange 
Number 



f "New York 

SOAirporA J p K. 
Confirm / Is this 
correct?" 



FIG. 6A 
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FIG. 5B 



ClIDeTmire euccr mm r- » 



WO 01/26350 

PCT/USOO/26935 



SOWeather 

NOTES: 
Global state: 
CurrentCitles: can be 
1 or more 
ReadingMode: 
todays, extended, both 
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Initial Prompt: 
"Getting weather for 

<city1> <cityl\l>, 

or say another city" 

Initial Prompt: 

1. Ambiguous. "Is that 
_<city1 >, . . .or <cityl\l>?"_ 

2. State or Country Only. 
"For <state or country>, 
say the city." Can return 
0, 1,or more choices. 




Prompt: "Weather." 
"<sponsored by>" 

sets variables: CurrentCities=from 
CallerlD or caller s quicklist 
ReadingMode=caller"s default 



"new city" 

no speech (2.0 sec) 
^.^City, State, Country 

/Weather\ 
"Disambiguate 
City " 



City 

State 

County 




vE2 



Weather 
Get 
City 



Initial Prompt: 
"Say the City" 



JKL 



"extended forecast" 
ReadingMode=Extended 



For each current city, plays 
audio feed if available, 
, , mmw „ w u otherwise plays concatenated 
ReadForecast forecast. Plays todays weather 
44 * * and/or extended forecast. Sets 

ReadingMode to caller's default 
after each list item. 




"new city" 



Initial prompt: 

1 . Just read todays weather: "Say extended forecast 
or say another city." 

2. Just read extended forecast. "Say another city ° 

FIG. 5A 
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"long quotes' 
"shrt quotes" 




ore details" 



try to add to 
portfolio, play 
an appropriate 
prompt. 




mode is same 
as current 



try to remove 
from portfolio, 
play an 
appropriate 
prompt. 

Check details available 
(no prompt) 



I 

No 

CurrentStocks 



use some prompt 
as when actually 
changed to a 
different mode. 




Prompt: "no 
current stock" 



CurrentStocks; 
MorelnfoAvailable=F 



NoOetails 
..Error, 

Prompt: "no more 
info for that stock" 

I, 



"short- 




Prompt: "mode 
changed, change 
back by saying..." 
Sets GlobalMode to 
Short. 



Prompt: "mode 
changed. change 
back by saying..." 
Sets GlobalMode to 
Long. 



A CurrentStocks; A 
MorelnfoAvailable=T 



long" & 
\ r Morelnf oAvailable=T 



odeBeforeReac 
Pata^ 

Prompt: "mode changed, 
change back by saying..." 
Sets GlobalMode to Long 
before tranferring to 
ReadOata 



B 



FIG. 4C 



WWQTmrrc cucct/diii c nc\ 
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Different initial prompt if 
we're reading a random 
list of stocks versus 
reading the portfolio. 
Otherwise, acts the same 
in both cases. 

Uses the "pick list" list type. 
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State 

1 : short information array 
2: more information array 
3: where we are in the information 




FIG. 4B 
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SOStockQuotes 

NOTES: 

Global state kept in Quote object: 
CurrentStocks (such as IBM) 

CurrentStocks can be 1 or more 
GlobalMode (long or short) 
MorelnfoAvailable (is there more 

to say about the CurrentStocks?) 



see automatic-porttolio.txt 
tor information about 
reading a portfolio. 



9/20 



nothing or 
confirmation 



'long quotes" 
"short quotes" 
"more details" 





Prompt: "Stock Quotes are 
delayed 20 minutes." 

and sets variables: 
CurrentStocks=l\IIL, 
MorelnfoAvailable=F, 
GlobalMode=short (or 
from user profile) 

stock name, index name, "major index" 



Initial prompts: 

1. No CurrentStocks set 

2. CurrentStocks set & Morelnfo 
Available=T ("more details or pick a 
new stock") 

3. CurrentStocks set & Morelnfo 
Available=F ('pick a new stock") 

4. The second time at this state 
(that is, after the user has said 
anything and gotten us back here), 
also include a prompt telling them 
how to get out of this app. 



stock name, index 
-name, "major index" 



All other 
cases 



User picked 
a stock and 
there's info 
for it 
OR 

User said 'long 
quotes' and there's 
more info for the 
current stock 



If empty, play 
appropriate prompt. 



This guy sends a request to 
.data base and plays it back. 
Lots of possible initial prompts 
depending on data received. 
Those are described elsewhere. 





P 



P 



No prompt 

Before transferring to 
SOReadOata sets 
CurrentStocks & 
Morelnfoavailable (to T if 
GlobalMode=Short & 
CurrentStocks isn't an index, 
to F in all other cases) 

FIG 



Can return 
0,1, or 
more valid 
choices. 



here 1 or more stocks 
to look upT^ncT 



(nqjjrpmt) - ' 



p 



4A 
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Gamble" 
(see Fig. 3A)' 
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"I found 3 grocery stores in 
• and around Podunk." 



Business Finder 



"next' 
"previous' 





Turn off auto- 
advance. "You 
chose <repeat 
info. <Give phone 
#>. Say 'driving 
directions' [or 
connect me']. 
v c ad spots?- 



"First location: [Safeway,] [1.2 mi away 
at] 4321 Logan Lane." 
"Next location: [Albertson's, ] [2.4 mi 
away at] 5432 Alma Street." 
"Last location: [Lucky,] [4.1 mi away 
at] 6543 Main Street." 
Say read again', ['find nearest',] ['find 
similar',] ['cont'.j 'new search'." 

CIO 



"new search" 
C9 




"driving directions" 



Leave list. \ 
"Driving \ 
Kngwn?' Directions. I'll \ 
save your search \ 
results, so you \ 
/ ves v can come back if x 
* you want." 




"find nearest" 



C8 

"find similar" 





(See Fig. 1A) 



Map 
rand to category 




"connect 
me" 



SO Source , 

Address ) " Do y° u want 
to start from 

932 Elm St, 

Podunk. CA? 

yes or no 



connect 
me" 



\ 

\ 




(See Fig. 1A) 



FIG. 3B 



Connect *• 

■...call...-- 



Leave list. 

"I'll transfer your call. When 
you're done talking, press 
the star key 3 times to 
come back to the service, 
or just stay on the line." 



SUBSTITUTE SHEET (RULE 26) 
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Welcome 
Jvlessac 
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"Business Finder" 



Business Finder 



/ cn A( , olirT , Q \ "I'll look for businesses in 
' Locatton ' Podunk - CA - ,s that ri 9 ht? " 



no 



yes 



~SlT v \ "Say the name of a busi- 
, Brand/ \ ness, such as Kinko's, or 
C3 [category (&| a type of business, such 
^confirm)/ as copy centers or 
grocery stores." 



C2 

'SlT 
'City-State 
(& 

sonfirm), 



"Name the 
city and 
state you 
want." 

mis-rec error prompt 
& reject error prompt 



1 



50-mile- 
idius searct 





"OK, I II look for that. 



zero matches 

1 match within within 10 miles 

10 mile s ^ Screen 6ut^ 

<^matches>1 0^>- 

mi^yjfay^"^ >2 matches 

>2 matches 
within 10 miles 



"I found 23. Do 
you want to give 
me your location 
so I can find the 
nearest ones?" 



C5 

zero matches 
within 50 miles 




1 match within 
50 miles 



For Preamble & SO List 
Results: The nearest one I 
know about is [Safeway,] 
about 86 miles away at 
332 Ester Street in 
Sometown, Nevada." 



50-mile 
new POL 



>0 matches 
(list nearest 5) 




Preamble 




zero matches 



Return to SO 
Assume Location 



FIG. 3A 
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, Name a city 
SOCityState) and state." 
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Traffic" 



Processes 
callerlD 



SOTraffic 
get city and confirm 

SOCityState is also used in Address 
and Weather (I presume). What's the 
impact on those apps if we change the 
behavior here? 



IsSupported ^, no , 
Metro, 



HowMany 
JnState? 



Prompt depends on how many 

metros in that state: 

0: "Honolulu, Hawaii. Traffic reports 

are not supported for Hawaii." 

1: "Reno, Nevada. In Nevada, traffic 

reports are only available for Las 

Vegas." 

>1: Traffic reports are not 
supported for San Luis Obispo, 
California." 



Then, reprompt SOCityState, 
with "Name another city and 
state. Or name another service." 



'Denver, Colorado. 
Is that right?" 
// might seem -different" to 
check IsSupportedMetro 

before con firming the user s response, but it makes for a more 
efficient dialogue (see sample #2 below.) 



named a , \.„. . 



Traffic,/ traffic for the SF Bay 



I 



Area. [Or name another 
city and state.]" 




Back to Fig. 1A 



1. User says a supported metro: 

Traffic. Getting traffic reports for the Greater 
Spokane area. Or name another city and state. 

"Mountain View, California" 
<isSupportedMetro=yes> 
Mountain View. California. Is that Right? [explicit 
confirm] 

"yes" 

Mountain View, CA. Getting traffic reports for the 
Greater San Jose area, [omit or name another. . 7 
[still include time for user to say stop '?] 

2. User says an unsupported metro: 
Traffic. Getting traffic reports for the Greater 
Spokane area. Or name another city and state. 

"Reno, Nevada" 
<isSupportedMetro=no> [omit explicit confirm if 
metro not supported) Traffic reports are not 
available for Reno, Nevada. Name another city and 
state. <listen 3 seconds> If you're done here, say 
Home, [new no-speech prompting. Doable?) 

"Las Vegas, Nevada" 
Us Vegas, Nevada. Is that right?... 



3. If you say 'no' to any implicit or explicit 
confirm, or if your callerlD is not in a 
supported metro, you land in SOCitystate: 

Name a city and state, [should this be: what city 
and state do you want traffic for?) 

"Denver, Colorado" 
<isSupportedMetro> 
Denver, Colorado. Is that right? [explicit 
confirm] 

"yes- 
Denver, Colorado. Getting traffic reports for the 
Greater Denver area. 
[omit or say another. . . 7 

-0R- 

*no" 

Please repeat the city and state. 



FIG. 2B 
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SayHello^> Traffic" 




named a 
city/state 



SOTraffic 

Prompt depends on how 
many metros in that state: 
0: "Honolulu, Hawaii. Traffic 
reports are not supported 
for Hawaii." 
1 : "Reno, Nevada. In 
Nevada, traffic reports are 
only available for Las 
Vegas." 

>1 : Traffic reports are not 
supported for San Luis 
Obispo, California." 

Then, reprompt SOCityState, 
with "Name another city and 
state. Or name another 
service." 



SOGetMetro "Mountain View, California. Getting traffic for the 
SF Bay Area. Or name another city and state." 




"Do you want another 
traffic report for the 
SF Bay Area?" 

Only ask if they heard 
traffic for a particular 
road. (Dark lines) All 
other cases, go 
directly to end state. 



no 

EndState 
"Going to Home" 



FIG. 2A 
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'When you 
signed up, 
you gave a 
date to use as 
an alternate 
password. 
Say the date 
now." 



"June 15, 1976.\ 
Is that right?" 



"Say your account 
phone number 
with area code" 




acct# 



no /SOSwitch**. 



Is that rightr 



"Sorry, that 
phone number 
and the date you 
entered don't 
match." 



•If you've forgotten 
your password, send 
e-mail to 

support@example.com. 
In the meantime, feel 
free to use the service 
as a guest." 



"[Hi, Bob!] 
You're logged in." 
[if not from 
POAcct+i.d.Available?J 



Where 'd you 
come from' 




check to see if the 
caller ID# is a 
pre-existing acct # 
(either theirs or 

someone else's) SOChange 

\ Pin ' yes 



"Sorry, that 
i.d.# is not 

available. 
Please try 

another." 



no 



Check to see if acct# and i.d. is taken 
by s.o. other than the current user. 



SOGet 
\ Pcode 

* 

X 

i SOPcode 
\ CandC 

yes { 

POAcct+i.'cf. :# 
-.Available?.-*' 



• "Enter a new 4 
/ to 8 digit i.d.#. 



"#####. Is 
this right?" 



.•continue in'; 
\\ service// 

• If user came 
from top level or 
said "Login", go to 
I Home. 

If a service 
prompted user to 
log in, continue at 
previous prompt 
(if user is not 
logged in) or next 
logical prompt (if 
user is logged in). 



"Okay, your i.d.# is 
changed, and you're 
logged in". 

FIG. ID 
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SONewAccount 

• Allow universals. 

• 'cancel' or "exits 
sign-up and brings 
user back to Home or 
service from which 
he signed up. 



"Sorry, that i.d.# 
is not available. 
Please choose a 
different i.d.#." 
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"Okay, this won't take long. To exit, say 

cancel', or press star." 

...then: 

"For your account number, say or enter 
your personal phone number with area 
code, such as your home or cell phone." 



"### ###-#####. Is this right?" 



To distinguish your account 
from others that might share 
the same phone #, please say 
or enter a 4 to 8 digit i.d.#." 
Allow touch tones. 



"#####. Is this right?" 



New user info/tutorial: 

• If returning to Home now, 
play promo for tutorial 
(deferred past launch!) 

• Otherwise, play promo on 
next return to Home, and in 
next couple of phone calls 
(deferred past launch!) 

• Don't promote tutorial if 
user is signing up from 
within a service (N/A till 
after launch) 



"Thanks for signing up. To 
personalize your account, 
please visit example.com." 
then: 

"You're logged in." 



no .. •PO*Acct+i.cf:# 
"••..Available?.-- 

yes 




"As an alternate password, choose a 
date you can remember easily. Say 
the month, day, and year, or to skip 
this step, say 'skip'." 



"<month> <day> <year>. Is this right?" 



Where 'd you 
.come from 




FIG. 



^Home^ 



• continue in; 
V\ service// 



• If user came from top level or said 
"Login', go to Home. 

• If a service prompted user to log 
in, continue at next logical prompt. 



RURSTmiTP cucrrmiii c ic\ 
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SOLogin 

■ Allow universals; 
user can say 
'<service>', bypassing 
login 

'cancel' or *=continue 
where you left off 
(include 
in prompts?) 
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Cases: 

• from top level, after saying an i.d. # 

• saying 'Login' from anywhere 
(as if it's a service) 

• when prompted by a service to log in 
(to use personalization); say an i.d. #, 
then come here 




Does i.d.# match 
caller ID? 
• If no: go to 
SOSwitchAccounts 
(no 'invalid login' 
prompt) 



• continue in; 

'•/•.service// 



"Sorry, i.d.# 
doesn't 
match 
phone #° 



"Would you like me to 
add the number you're 
calling from, 555 
555-5555, as an 
alternate phone 
number on your 
account?" (if it's 
exactly the 3rd time 
calling from this phone 
#: don't keep offering) 



"[Hi, Bob!] 
You're logged in" 



• If user came from 
top level or said 
'Login', go to Home. 

If a service 
prompted user to 
log in, continue at 
next logical prompt. 



:SOAddAcct!-^i. 



T'no 



"OK, HI. add It" 
' POAddAcct ":- — 



FIG. IB 
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Top-ievet Call Flow 



1/20 




from beginning of phone call, 
from end of a service, 
when user says 'Home', 
or from login/signup 



If returning to Home, 
skip welcome and 
PIN prompt 



"Say your 4-digit PIN, say 'new 
account', or just name a service, 
like Traffic or Stock Quotes." 

Played only on first visit to Home 
menu (beginning of call). 

■<service>" 

S>-4? '<service>* 
z^on^v Tutorial' 
Y s 9 \\ Login* 
<:service>j (same grammar and 

actions as Home, 
below) 



Shuffle, or make 

context-sensitive. 

Examples: 

• "Need help getting around? 
Say 'Driving Directions'" 

• "Are you new to BeVocal? 
Say Tips'" 



"Here are your choices." (played first 
time only.) "When you know what you 
want, be vocal about it. Say: Traffic 
Reports, BeVocal this, BeVocal that, 
BeVocal login, BeVocal Tips" 



'<services>' 



Tutorial 



(Same grammar and 
actions as Say PIN or 
Service, above.) 



FIG. 1A 
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canceling the subsequent action upon a caller's corrective vocalization. 
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determining driving directions between the reference address and the 
business address, and conveying the driving directions to the caller. 



60. The method in claim 27 further comprising the step of, 

s conveying that the caller can request to hear directions to a business 

address and if the caller requests to hear directions, 

prompting the caller to enter an reference address from which to 
determine driving directions, 

determining driving directions between the reference address and the 
10 business address, and conveying the driving directions to the caller. 

61 . In a vocal user interface for use on a computer system f a method of 
interfacing with a caller, comprising: 

querying the caller with a prompt intended to evoke either an 
affirmative response or a negative response from the caller, and 

is interpreting any response other than an affirmative response or a 

negative response as an affirmative response to the query, and 

utilizing the caller response in a subsequent query to the caller. 

62. In a vocal user interface implemented on a computer, a method 
20 of interfacing with a caller, comprising: 

making an educated inferential decision regarding what will be the 
caller's most probable utterances in a conversation state where caller-specific 
information is accessible, 

performing a subsequent action within the vocal user interface based 
25 on the educated inferential decision, and 
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conveying the business addresses to the caller. 
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10 



57. The method in claim 23 further comprising the step of, 

conveying that the ca.ier can request to hear directions to a business 

address and if the caller requests to hear directions, 

prompting the cal.er to enter an reference address from which to 
determine driving directions, 

determining driving directions between the reference address and the 
business address, and conveying the driving directions to the caller. 

58. The method in claim 25 further comprising the step of, 

conveying to the ca.ier the number of businesses found and 
prompting whether the caller desires to hear the business addresses 

closest to a reference address, and if the caller answers affirmatively, 
obtaining a reference address from the caller, 

searching the independent service-database to find relevant business 
addresses, 

conveying the business addresses to the caller. 



20 59. The method in claim 25 further comprising the step of, 

conveying that the caller can request to hear directions to a business 
address and if the caller requests to hear directions, 

prompting the caller to enter an reference address from which to 
determine driving directions, 



15 
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utilizing the caller response in a subsequent query. 
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53. The method in claim 14 wherein the investment indicator comprises, 

an investment indicator selected from the group consisting of; a 
s publicly traded investment vehicle ticker symbol, the name of the business 
entity issuing the publicly traded investment vehicle, a market indicator ticker 
symbol, or a market indicator name. 

54. The method in claim 21 wherein the step of conveying further 
comprises; 

prompting the caller to vocally enter a request for extended forecast 
information, and if it is available, 

conveying the extended forecast information to the caller. 

55. The method in claim 23 wherein, 

acceptable caller vocal entries are selected from the group consisting 
of; a particular business name, and a business type. 

56. The method in claim 23 further comprising the step of, 
conveying to the caller the number of businesses found and 
prompting whether the caller desires to hear the business addresses 

closest to a reference address, and if the caller answers affirmatively, 
obtaining a reference address from the caller, 

searching the independent service-database to find relevant business 
addresses, 
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the address software routine further comprises a software dialog that 
accepts verbally entered addresses from the caller. 



49. The driving directions vocal user interface in claim 46 wherein, 

the address software routine accepts addresses from an independent 
software program. 



50. The driving directions vocal user interface in claim 46 further 
comprising, 

10 software means for storing the driving directions, and 

software means for conveying the driving directions to the caller in a 
subsequent interaction with the driving directions vocal user interface. 

51 . The driving directions vocal user interface in claim 49 wherein, 

15 tr »e independent software program is selected from the group 

consisting of; a business finder program module, or an address finder 
program module. 

52. In a vocal user interface for use on a computer system , a method of 
20 interfacing with a caller, comprising: 

querying the caller with a prompt intended to evoke either an 
affirmative response or a negative response from the caller, and 

interpreting any response other than an affirmative response or a 
negative response as a negative response to the query, and 
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a telephony software dialog that accepts a caller's vocal command to 
initiate a telephone call to contact the business. 



45. The business finder vocal user interface in claim 40 further comprising, 

s a driving directions software dialog that accepts a caller's source 

address and computes driving directions to the retrieved results of the 
business search request. 



46. A driving directions vocal user interface in a computer system 
10 comprising, 

an address software routine that accepts source and destination 
addresses during a telephone call, 

a software interface that accesses an service-database to search for 
and retrieve driving directions between the source and destination addresses, 

1 5 and 

text-to-speech software that translates the retrieved driving directions 
to speech for conveyance to a caller 

47. The driving directions vocal user interface in claim 46 wherein the 
20 address software dialog further comprises, 

a second software dialog that prompts for and accepts a callers 
request that the directions be given from a point other than from the source 
address. 



25 48. The driving directions vocal user interface in claim 46 wherein, 
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software code that infers a city and state for a callers desired business 
location based upon information delivered during a telephone call, 

a business finder software dialog that prompts the caller to vocally 
enter a business search request, 

a software module that accesses a service-database to search for and 
retrieve results for the business search request, and 

text-to-speech software that conveys the results to a caller. 



41 The business finder vocal user interface in claim 40 wherein, 

the information delivered during a telephone call is at least a portion of 
a caller telephone number. 



42. The business finder vocal user interface in claim 40 wherein, 

in a subsequent caller interaction with the vocal user interface, the 
software code that infers a city and state for a callers desired business 
location based upon information delivered during a telephone call, infers 
based on a previous caller interaction with the vocal user interface. 



43. The business finder vocal user interface in claim 40 wherein, 

acceptable caller vocal entries are selected from the group consisting 
of; a particular business name, and a business type. 



44. The business finder vocal user interface in claim 40 further 



comprising, 
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37. An address finder vocal user interface for use in a computer system 
comprising; 

a first caller address search software dialog that prompts for and 
accepts search requests from the group consisting of; an address within a city 
5 and state, a landmark address non specific to callers, a landmark address 
specific to a caller, 

a software interface that accesses a service-database to search for 
and retrieve results for the search request, and 

text-to-speech software that translates the results to speech. 



38. The address finder vocal user interface in claim 37 wherein, 

the address search request is an address within a city a'.d state, and 
further comprising, 

a second caller address search software dialog that prompts for and 
accepts search requests from the group consisting of; a street number or a 
cross-street name. 



39. The address finder vocal user interface in claim 37 wherein, 

the address search request is a landmark address specific to a caller, 
and further comprising, 

software that access and retrieves an address stored in a private caller 

profile. 



40. A business finder vocal user interface for use in a computer system 
comprising, 
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32. The method in claim 31 further comprising, 

pausing the step of conveying the driving directions to the caller upon a 
vocal command from the caller. 

5 

33. The method in claim 31 further comprising, 

saving the list of driving directions in a caller private profile, 
resuming the step of conveying the driving directions to the caller. 

10 34. The method in claim 33 wherein, 

the step of resuming is performed in a subsequent vocal user interface 
application session. 

35. The method in claim 31 wherein, 

is the step of conveying the driving directions to the caller is performed in 

a manner selected from the group consisting; email, fax, wap, or audible. 

36. The method in claim 31 further comprising, 

prompting whether the caller wants to hear all of the directions on a 
20 route from the start or from another point in the route. 
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conveying the information to the caller. 



29. The method in claim 28 wherein 

the flight information request comprises arrival or departure information 
5 for unknown airlines, and the method further comprises, 

searching the independent service database for information items 
meeting the request, 

retrieving information items meeting the request, 

conveying the information items to the caller in a list. 

10 / 

30. The method in clair; 28 wherein 

the flight information request comprises arrival or departure information 
regarding a particular flight that has multiple legs, and the method further 
comprises, 

is prompting if the caller wants to hear information regarding all the legs 

or regarding a particular leg. 



31 . The method in claim 9 wherein, 

the caller selected the driving directions service-database, and the 
20 method further comprises, 

prompting the caller to enter at least one address, 

searching the driving directions service-database, 

conveying the driving directions to the caller. 

35 
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searching, he se™ce.da,abase,o find a business address satisfying 
the business search request, 

conveying the business address to the caller. 



5 26 



The method in ciaim 25 wherein the information delivered during the 
telephone cat, is seiecfed from a group „, infomlation items c 

port,on o, the called tetephone number, or a city and state stored in a ca„e, 
private profile. 



15 



20 



■ o 27. The method in claim 26 further comprising the step of. 

conveying to the caller the number of businesses found and 
prompting whether .he caller desires ,o hear the business addresses 
closes. ,o a reference address, and if the caller answers affirmatively, 
obtaining a reference address from the caller, 

searching .he independent service-database .o And relevant business 
addresses, 

conveying the business addresses to the caller. 

v 

28. The method in claim 9 wherein if the flight information service-database 
•s selected, the step of accessing an service-database further comprises; 

prompting the caller to vocally enter a flight information request, 

searching the independent flight information service-database, 

retrieving information that most closely matches the caller's flight 
information request, 
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23. The method in claim 9 wherein if the business finder service-database 
is selected, the step of accessing an service-database further comprises; 

prompting the caller to vocally enter a city and state, 

prompting the caller to vocally enter a business search request, 

searching the service-database to find a business address satisfying 
the business search request, 

conveying the business address to the caller. 



24. The method in claim 23 further comprising the step of, 

prompting whethor the caller desires to hear the business address, and 
if the caller answers affirmatively, 

prompting the caller to enter an reference address from which to 
determine driving directions, 

determining driving directions between the reference address and the 
business address, and 

conveying the driving directions to the caller. 

25. The method in claim 9 wherein if the business finder service-database 
is selected, the step of accessing an service-database further comprises; 

inferring a city and state based upon information delivered during the 
telephone call, 

prompting the caller to vocally enter a business search request, 
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inferring a city and state for which weather information is desired based 
upon information conveyed by the caller, 



searching the service-database to find current weather conditions for 
the city and state; 

5 conveying the current weather conditions to the caller. 

20. The method in claim 19 wherein the information conveyed by the caller 
is selected from a group of information items consisting of; a portion of the 
caller's telephone number, or a city and state stored in a caller private profile. 

10 

/ 

21 . The method in claim 9 wherein if the weather condition service- 
database is selected, the step of accessing an service-database further 
comprises; 

prompting the caller to vocally enter a city and state for which weather 
is information is desired, 

searching the service-database to find current weather conditions for 
the city and state; 

conveying the current weather conditions to the caller. 

20 22. The method in claim 21 wherein the step of conveying further 
comprises; 

prompting the caller to vocally enter a request for extended forecast 
information, and if it is available, 

conveying the extended forecast information to the caller. 
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prompting the caller to vocally select an investment indicator about 
which to receive more detail, and 

conveying more detail to the caller upon receipt of the caller's vocal selection. 

5 16. The method in claim 9 wherein if the stock information service- 
database is selected, the step of accessing the service-database further 
comprises: 

retrieving an investment indicator from a private caller profile; 

searching the service-database for the most recent value associated 
10 with the investment indicator, 

conveying the most recent value to the caller. 

17. The method in claim 14 further comprising the step of, 

adding or removing an investment indicator from the private caller 
is profile upon receipt of a vocal command to do so by the caller. 

18. The method in claim 14 further comprising the step of, 

providing more or less information about a particular investment 
indicator upon receipt of a vocal command to do so by the caller 

20 

19. The method in claim 9 wherein if the weather condition service- 
database is selected, the step of accessing an service-database further 
comprises; 
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searching the number of traffic reiated incidents that pertain to the city 
and state; ' 

prompting the caller to enter a road by name; 

searching the location of traffic related incidents that pertain to the 
s road, and if there is traffic related information regarding the incidents on the 
road; 

conveying ,he traffic related information regarding the incidents to the 
caller. * 



1 3. The method in claim 1 2 further comprising, 

prompting the caller to vocally select a particular traffic related incident 
about which to receive more detail, and 

conveying more detail ,o the calter upon receipt of the caller* vocal 
selection. 



14. The method in claim 9 wherein if the stock information service- 
database is selected, the step of accessing the service-database further 
comprises: 

prompting the caller to enter an investment indicator; 

searching the independent service-database for the most recent value 
associated with the investment indicator, 

conveying the most recent value to the caller. 
15. The method in claim 1 4 further comprising, 
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10. The method in claim 9 wherein if the traffic condition service-database 
is selected, the step of accessing the service-database further comprises: 

prompting the caller to vocally enter a city and state; 

s searching the number of traffic related incidents that pertain to the city 

and state; 

prompting the caller to enter a road by name; 

searching the location of traffic related incidents in that pertain to the 
road, and if there is traffic related information regarding the incidents on the 
o road; 

conveying the traffic related information regarding the incidents to the 

caller. 



1 1 . The method in claim 1 0 further comprising, 

prompting the caller to vocally select a particular traffic related incident 
about which to receive more detail, and 

conveying more detail to the caller upon receipt of the caller's vocal 
selection. 



o 12. The method in claim 9 wherein if the traffic condition service-database 
is selected, the step of accessing the service-database further comprises: 

inferring a city and state of interest for the caller based upon at least a 
portion of the caller's telephone number; 
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aborting the processing of any step in the method upon receipt of a 
vocal command to do so by the caller. 

6. The method in claim 3 further comprising, 

5 checking a caller private profile that is identifiable with the caller by an 

account number. 



7. The method in claim 6 further comprising, 

inferring the caller account number based upon information delivered 
i o during the telephone call. 

8. The method in claim 7 further comprising, 

storing a portion of the caller's desired information in the caller private 
profile, and 

is inferring at least a portion of the caller's desired information based 

upon the stored portion of the caller's desired information. 



9. The method in claim 1 wherein the service-database that contains 
information regarding the caller's desired information is selected from a group 
20 of service-databases consisting of; 

a traffic condition service-databases, a stock information service- 
databases, a business finder service-databases, a weather condition service- 
databases, a flight information service-databases, or a driving directions 
service-databases . 
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prompting the caller to enter a second vocal expression that 
more narrowly describes, relative to the vocal expression in the first 
vocal user interface program module, the caller's desired information, 

accessing a service-database that contains information 
i regarding the caller's desired information, 

searching the service-database for a database sample that most 
closely satisfies the service-search expression, 

retrieving the caller's desired information from the service- 
database, 

) formatting the caller's desired information into a vocal output, 

and 

conveying the vocal output of the caller's desired information to 
the caller, 

within the second vocal user interface program module. 

3. The method in claim 1 further comprising the step of, 

inferring at least a portion of the caller's desired information based 
upon information delivered during a telephone call. 

4. The method in claim 3 wherein the information delivered during a 
telephone call comprises, 

at least a portion of a telephone number. 

5. The method in claim 1 further comprising: 
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1. In a computer system, a method of retrieving and conveying 
information requested by a caller, comprising: 

initiating a vocal user interface application session upon receipt of a 
5 telephone call from the caller; 

within a first vocal user interface program module, prompting the caller 
to enter a first vocal expression that describes the caller's desired information; 

prompting the caller to enter a second vocal expression that more 
narrowly describes, relative to the vocal expression in the first vocal user 
10 interface program module, the caller's desired information, 

accessing a service-database that contains information regarding the 
caller's desired information, 

searching the service-database for a database sample that most 
closely satisfies the service-search expression, 



15 



retrieving the caller's desired information from the service-database, 
formatting the caller s desired information into a vocal output, and 
conveying the vocal output of the caller's desired information to the 



caller. 



2. The method in claim 1 further comprising the steps of, 

recognizing the first vocal expression as a command to transition to a 
second vocal user interface program module; 

transitioning to a second vocal user interface program module, and 
performing the steps of, 

26 » . 
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Speech Object to determine directions to a particular location, save the driving 
directions to the caller private profile, and disconnect the telephone call. The 
caller is prompted whether they would like to resume using the saved driving 
directions when they call again and login (SOResume H6). 

5 The preferred embodiment of the invention is described above in the 

Drawings and Description of Preferred Embodiments. While these 
descriptions directly describe the above embodiments, it is understood that 
those skilled in the art may conceive modifications and/or variations to the 
specific embodiments shown and described herein. Any such modifications 

1 o or variations that fall within the purview of this description are intended to be 
included therein as well. Unless specifically noted, it is the intention of the 
inventor that the words and phrases in the specification and claims be given 
the ordinary and accustomed meanings to those of ordinary skill in the 
applicable art(s). The foregoing description of a preferred embodiment and 

is best mode of the invention known to the applicant at the time of filing the 

application has been presented and is intended for the purposes of illustration 
and description. It is not intended to be exhaustive or to limit the invention to 
the precise form disclosed, and many modifications and variations are 
possible in the light of the above teachings. The embodiment was chosen 

20 and described in order to best explain the principles of the invention and its 
practical application and to enable others skilled in the art to best utilize the 
invention in various embodiments and with various modifications as are suited 
to the particular use contemplated. 
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Object or from another program module, such as the Business Finder Speech 
Object. If the Speech Object is evoked from another program module such as 
Business Finder Speech Object, known addresses are passed from the first 
program module to the Driving Directions Speech Object. Otherwise, the 
b Driving Directions Speech Object contains speech objects to determine either 
the caller's source or destination address (SOSourceAddress H1 and 
SODesitinat ion Address H2, respectively). 

The Driving Directions Speech Object interfaces with the API of an 
independent service-database to retrieve point-to-point driving directions. 

10 Upon retrieval of the driving directions, the Driving Directions Speech Object 
formats the driving directions into a list that is conveyed to the caller 
(SOReadDirections H3). The caller can navigate the list by uttering 
appropriate speech grammars (e.g. "next", "previous", "start over", "stop", 
"pause"). Alternatively, the caller may also receive the driving directions by 

is email or facsimile (SODrectionDeliveryMethod H4). Moreover, if a portion of 
the caller's driving directions includes a particularly long stretch of road, the 
Driving Directions Speech Object dynamically creates a prompt to query 
whether the caller wants to hear directions from the first step or starting after 
that road (SOStartFrom H5). 

20 For logged in callers, the Driving Directions Speech Object has the 

added capability of storing a set of driving directions in the caller private 
profile after they have been determined, and further creating a prompt that 
evokes the saved directions. Thus a caller may use the Driving Directions 
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The caller may also pick a flight without any specific information about 
a airline or flight number. Figure G3 depicts the Itinerary Speech Object 
which is invoked if the caller does not know the airline or flight number when 
conversing with the Flight Information Speech Object. The Itinerary Speech 
s Object includes speech objects that allow the caller to choose a flight 

regardless if an airline is known. For example, if the caller has not entered an 
airline in the Flight Information Speech Object, the Itinerary Speech Object will 
engage the caller in a dialog to determine an airline (e.g. tCheckAirline G10, 
soAirline G11). If the caller does not know the airline, the Itinerary Speech 
10 Object will engage the caller in a speech object to determine the airline if it is 
supported by the Service-Database 60. If not the caller is prompted for 
ar.other airline (tAnotherAirline G12). 

The Itinerary Speech Object engages the caller in speech objects to 
determine the departure city (SOAirportCity(departure) G13) and arrival city 
is (SOAirportCity (arrival) G14) and then in a fight time Speech Object 
(soFlightTime G15). The Itinerary Speech Object next checks with an 
Itinerary check and confirm speech object (SO ItineraryCandC G16), gets a 
list of flights meeting the caller's requirements from the flight information 
Service-Database 60, and conveys it to the caller (SOReadRoutes G17). 

20 Driving Directions Program Module Speech Object 

The Driving Directions Speech Object determines point-to-point driving 
directions given two addresses. See Figure H. The Driving Directions 
Speech Object can be evoked both as a stand-alone program module Speech 
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transition ,o the High, Information Speech Object, the calier is prompted to 
u«er an airtine and flight number (SOAiriineRigh, G2). ,o utter an aifline or 
flight number, or to utter neither the airline or flight number. 

Attentate speech obiects are transitioned to depending upon the extent 
» o. intcmation known by the cailer and conveyed to the Flight Information 
Speech Object. „ the caller utters either onfy the airline or flight number, the 
Flight Information Speech Object transitions ,„ speech objects that prompt ,he 
caller to utter either the flight number (SOFIightNumber G3) or the airline 
(SOAirline G4), respectively. The Flight Information Speech Object then 
.0 conflrms the caller's airline and flight number (SOFIighUnfoCandC G5, and 
assumes ma, flight information is desired on me day o, the ca„, bu, optionally 
allows me caller ,o check fligh, information for anomer dale (SOFIightDate 
G6). Upon confirmation o, the eater's desired fligh, information the Fligh. 
information Speech Object interfaces wfln the AP, o, the fligh, information 
» Service Database to retrieve ,he caller's desired flight information. 

The Flight Information Speech Object will transition alternate speech 
objects depending upon the fligh, intension retrieved from the Service- 
Database. No available infonnation results in a prompt to perform another 
search (.SearchAnotherFligh, G7). The existence of multiple fligh, legs 
». invokes a Speech Object tha, allows the catler to optionally choose a specific 
iag of the flight (SOChooseLeg G 8 , for which to hear information. Ometwise. 
the Flight .nformation Speech Object wil, convey me flight status information 
to the caller (SOFIightStatus G9). 
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Upon uttering a city and state, the caller is engaged in dialogs to name 
and confirm a desired street (SO_StreetName F3), name and confirm a street 
number (SO_StreetNumber F4), or alternatively, if the street number is not 
known, a cross street (SO_CrossStreet F5). When the Address Module has 
5 received the caller's desired address, the Address Module prompts the caller 
to confirm the address or, in appropriate circumstances will engage the caller 
in a disambiguation and confirmation Speech Object 
(SO_AddressDisambiguationAndConfirm F6) to resolve the ambiguity. 

Upon obtaining the caller's final address, the Address Disambiguation 
n Speech Object engages the caller in speech objects that enable the caller to 
change only a subset of information conveyed to the Address Disambiguation 
Speech Object or alternatively, to begin searching from scratch. For example, 
the caller may change the street name, or the cross street name. 

Flight Information Program Module Conversational State Diagram 

Figure G1 depicts the conversation state diagram of the Flight 
Finder Program Module ("Flight Finder Speech Object"). Upon a transition to 
the Flight Information Speech Object, the caller is greeted and prompted to 
utter whether the caller wants arrival or departure information (SO Arrival 
Departure G1) upon which the Flight Finder Speech Object transitions to the 
Flight Information Program Module ("Flight Information Speech Object"). 

Figure G2 depicts the conversation state diagram of the Flight 
Information Program Module ("Flight Information Speech Object"). Upon a 
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Object is ordinarily transitioned to from another Speech Object that needs to 
locate a specific address to perform a function that requires knowing a 
specific street address (e.g. driving directions). Upon a transition to the 
Address Speech Object, the caller is prompted to utter a particular city and 

5 state of interest (SO_CityState F1) or to utter a Landmark. 

Landmarks are preassigned speech grammars that can be both global 
or particular to each caller and stored in each caller's private profile. "Airport" 
is a special global grammar landmark that evokes an Airport Finder Speech 
Object. The Airport Finder Speech Object searches the caller private profile 
10 for a preferred preference and confirms this preference with the caller, who 
may opt otherwise and engage in a dialog to pick an alternate airport. 

If the caller utters another landmark that is particular to the caller 
private profile, the Address Module will access the address associated with 
the Landmark and return to the original program module from where the 

ib transition came. If however, there is more than one address that meets the 
caller's uttered Landmark (e.g. "airport"), the Address Module will transition to 
an airport city disambiguation list dialog ( SO_AirportCity F2) to identify the 
caller's desired airport and subsequently confirm and convey the desired 
information to the caller. The Address Speech Object will loop back and 

20 reengage the caller in the airport city list dialog if the city and state is not 

supported by the database or if the caller conveys that the choice of airports is 
incorrect. 
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to the caller's preferences in accordance with previously described 
capabilities. Process flow control returns to the Stock Information Speech 
Object upon completion of the list of stock information. 

Weather Conditions Program Module Conversational State Diagram 

5 Figure E1 depicts the Weather Conditions Speech Object ("Weather 

Speech Object"). Upon receipt of a caller's utterance meeting an acceptable 
speech grammar for the Weather Speech Object, the caller is greeted. 
Moreover, the Weather Speech Object infers a city for the caller based upon 
the caller private profile or caller's telephone number and conveys the 
o inference to the caller (WeatherAssumeCity E1 )'. Unless the caller utters a 
context specific cancellation speech grammar (e.g. "new city") within a finite 
time interval, the Weather Speech Object retrieves the weather information for 
the city. Else the Weather Speech Object prompts the caller to enter another 
city for which the Weather Conditions Speech Object will gather information 
(WeatherGetCity E2) and convey the most relevant weather information to the 
caller. Figure E2 depicts a List Speech Object for conveying the weather 
information to the caller in a list format and further checks the caller private 
profile to detect the preferred manner of receiving the weather information E3 
(i.e. extended or abbreviated forecasts). 

Address Locating Program Module Conversational State Diagram 

Figure F1 depicts the conversation state diagram of the Address 
Locating Program Module ("Address Speech Object"). The Address Speech 
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stocks or abbreviated information. Thus, the Stock Information Speech 
Object recognizes both contextual^ global - non temporal utterances (e.g. 
"long quotes") that will globally effect the extent of information to be conveyed 
about all stocks of interest, and item specific temporal utterances (e.g. "more 
> information", or "more details") that effect the extent of information to be 

conveyed only about the specific stock that was just conveyed to the caller. 

Item specific temporal utterances are characterized by a finite temporal 

duration during which a caller's utterance is interpreted as an utterance only 

for a specific item in the list. 

Figure D2 depicts a conversational state.diagram reflecting additional 
functionality of the Stock Information Speech Object including adding and 
removing a stock to the caller private profile and effecting the previously 
described global - non temporal speech grammars and item specific temporal 
speech grammars. If the caller utters a speech grammar to hear more about 
a particular stock while it is being read to the caller (e.g. "long quotes" or 
"details"), the Stock Sub-Module performs a search of the stock information 
database for more information, and subsequently transitions back to the Stock 
Information Speech Object and conveys an appropriate audible prompt to the 
caller depending upon the information retrieved by the performed search. 

Figure D3 depicts an example of a conversational state diagram for 
conveying stock information list items to the caller (SOReadData D2). The 
List Speech Object automatically sequentially relays the stock information to 
the caller stopping only to interpret caller utterances and make modifications 
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Speech Object by uttering a speech grammar that evokes the Stock 
Information Speech Object. 

Upon the caller's utterance of a speech grammar indicating that stock 
information is desired (e.g. "Stock"), the Stock Information Speech Object 
> conveys an audible confirmation to the caller (SO_AssumePortfolio D1). 
Further, if the caller has established a stock portfolio in the private caller 
profile, a speech object audibly alerts the caller that the Stock Information 
Speech Object will assume what stocks are of particular interest to the caller 
based upon the private caller profile. The Stock Information Speech Object 
then interfaces with the API of the Stock Information database and retrieves 
the most currently available data and reads it to the caller in a List Speech 
Object. 

The caller may opt out of the assumption by uttering a speech 
grammar that indicates the caller's desire to do so (e.g. the caller names a 
particular stock). If the caller's assumed portfolio is empty, or if the caller 
cancels the presumption, the Stock Information Speech Object prompts the 
caller to utter a stock information indicator (e.g. company name, ticker symbol, 
or market index name). Upon receipt of the caller's uttered stock information 
indicator, the Stock Information Speech Object performs a search of the stock 
information database and reads the stock information to the caller. 

Moreover, the Stock Information Speech Object permits the caller to 
customize preferences regarding how the information is to be conveyed to the 
caller. For example, the caller may wish to receive detailed information about 
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(SOJ-istResults C6), the caller can navigate the list by uttering an appropriate 
grammar such as "next" or "previous". The caller may also select a business 
on the list by uttering an appropriate speech grammar such as 'that one" or 
"more information". Once a caller selects a business on the list, the caller may 
5 choose either to receive driving directions or to place a telephone call to the 
business selected. The Business Finder Speech Object audibly confirms the 
caller's choice and prompts the caller to utter the caller's desired action 
(SO_OneLocation C7). If the caller utters a "connect me" or similar speech 
grammar, the Telephony Network Server initiates a telephone call to the 
10 telephone number associated with the business selected by the caller. Else, if 
the caller utters a speech grammar associated with "directions", the Business 
Finder Speech Object will access the Driving Directions Speech Object if the 
full address of the business selected by the caller was available in the 
Service-Database. 

1 5 Finally, the Business Finder Speech Object permits the caller to 

perform additional searches C9, search for similar type businesses C10 (i.e. 
within a same business type category), or find the nearest business C11 on 
the list by uttering appropriate speech grammars (e.g. "new search", "find 
similar 11 , or "find nearest", respectively). 

20 Stock Information Program Module Conversational State Diagram 

Figure D1 depicts a Stock Information Program Module conversational 
state diagram ("Stock Information Speech Object"). The caller can select the 
Stock Information Program Module from the above Main Menu program 
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matches that are more than a specified distance away (e.g. more that 50 
miles). If however, there are no matches within the specified distance, the 
Business Finder Speech Object adds back in the matches removed in the 
previous step. 

If there are multiple matches retrieved from the search, the Business 
Finder Speech Object prompts (e.g. SO_FindNearest C4) the caller whether 
the caller wants to hear the match that is closest to the caller's presumed 
vicinity. If a confirming speech grammar is conveyed by the caller, the 
Business Finder Speech Object transitions to the Address Finder Speech 
Object (SOAddress C5) which returns processing control to the Business 
Finder Speech Object when the Address Finder Speech Object has recorded 
the caller's desired address. The Business Finder Speech Object then 
conveys the matches that are nearest the vicinity of the caller's address. 
However, if the caller elected not to provide an address, or if the search 
retrieves no matches within a specified radius (e.g. fifty miles) that meet the 
caller's request, a search of maximum radius is performed and the results are 
conveyed to the caller. If a maximum radius search retrieves zero matches, 
the caller is prompted whether a new search is desired. 

The Business Finder Speech Object further includes the ability for the 
caller to initiate a telephone call that will connect the current call to a business 
establishment on the list, or provide driving directions to a business 
establishment. Figure C2 depicts a conversational state diagram of this 
additional functionality. As the search results are being read to the caller 
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Business Finder Program Module Conversational State Diagram 

Figure C depicts a Business Finder Service Program Module 
conversational state diagram ("Business Finder Speech Object"). The caller 
can select the Business Finder Module from the above Main Menu Speech 
Object by uttering a speech grammar that evokes the Business Finder Module 
(e.g. "Business Finder")- 

In a preferred embodiment of the Business Finder Speech Object, the 
region of interest for the caller is presumed based upon information retained 
in the caller profile or based upon the area code and prefix of the caller's 
telephone number. The presumption is conveyed to the caller (e.g. 
SO_AssumeLocation C1) who may either convey an affirmative speech 
grammar to confirm that the presumption is correct, or optionally select 
another region of interest with an utterance having a negative connotation(e.g. 
"cancel") that will invoke a transition to another Speech Object that prompts 
the caller to enter the desired region of interest (e.g.SO_CityState C2). 

Upon the caller's utterance of a speech grammar acquiescing to the 
Business Finder Speech Object's presumption or utterance and confirmation 
of an alternate city and state, the caller is prompted (e.g. SO_Brand/Category 
C3) to utter a specific brand name or to vocalize a category to search (e.g. 
"grocery stores"). Upon receipt of the caller's response, the Business 
Finder Speech Object interfaces with the API of the Business Finder 
Database and retrieves the information that most probably fulfills the caller's 
desires. The Business Finder Speech Object automatically first filters out 
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area if the caller at this time cancels the pending search by uttering a "cancel" 
or "stop" speech grammar. 

Differing prompts are conveyed to the caller depending upon the 
amount of traffic information retrieved from the traffic Service-Database. For 
instance, "no traffic incidents" can be directly conveyed to the caller, or the 
occurrence of single traffic incident can also be directly conveyed to the caller 
(SCLReadTraffic B3). Else, if there are several incidents, the Traffic Speech 
Object checks whether it has grammars of the metro area and if so prompts 
the caller to enter a primary road or utter whether all the traffic incident reports 
for that road are desired (SO_MajorRoad B4). If the Traffic Speech Object 
supports the major road, a confirmatory prompt (SO_RoadConfirm B5) is 
conveyed to the caller who may vocalize a confirmation and hear the traffic 
incident report for that major road (SO_ReadTraffic B3). Otherwise, if there 
are no highway grammars, all the traffic incidents are conveyed to the caller 
(SO_ReadTraffic B3). The list of traffic related incidents is initially brief, but 
the caller can request additional information by uttering "that one." After 
providing the additional information, the Traffic Speech Object continues 
reading the list. The Traffic Module prompts the caller to optionally perform 
another search prior to exiting to the Main Menu document. 

In an alternate embodiment, the Traffic Speech Object engages the 
caller in a series of dialogs to determine a specific road. The Traffic Speech 
Object subsequently interfaces with the API of the Traffic Service-Database to 
determine and convey any available information to the caller. 
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state, the caller may utter several of the same navigational choices previously 
discussed. 

Traffic Conditions Program Module Conversational State Diagram 

Figure B1 depicts a Traffic Conditions Program Module conversational 
5 state diagram ("Traffic Speech Object"). The caller can select the Traffic 

Speech Object from the above Main Menu Speech Object module by uttering 
a speech grammar that evokes the Traffic Speech Object (e.g. 'Traffic"). In 
turn, the Traffic Speech Object coveys prompts that direct the caller to 
utterances that indicate a region of interest for traffic condition information. 
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The Traffic Speech Object first processes the caller's area code and 
prefix, and if the metro area associated with the caller's area code and prefix 
are supported by the traffic Service-Database, the Traffic Speech Object 
conveys to the caller the presumption that the Traffic Speech Object will use 
the associated metro area for the caller's traffic region of interest 
is (SO_GetMetroTraffic B2). Otherwise, if the metro area for the city-state 

combination is not supported, the Traffic Speech Object prompts the caller to 
utter a particular city-state combination of interest (SO_City/State B1), and the 
Traffic Module confirms a metro area associated with the caller's selected 
city-state combination. If the selected metro area is supported by the traffic 
20 Service-Database, the Traffic Module confirms that it will search the traffic 
Service-Database (e.g SO_GetMetroTraffic B2) for traffic related incidents in 
that metro area. The Traffic Module will prompt the caller for a new metro 
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personal information that enables the other program module Speech Objects 
to make educated inferential decisions regarding what will be the caller's 
most probable selections or utterances. 

Figure A2 depicts a Login Speech Object (SOLogin A4) that permits 
the VUI Application to distinguish between callers. The Login Speech Object 
permits the caller to enter a personal identification number ("PIN") and 
enables the caller to invoke dialogs to determine a forgotten PIN 
(ForgotPasscode A2) or establish a new account (SONewAccount A3). The 
Login Speech Object associates each caller's PIN with their telephone 
number A10, thus upon login, the Login Speech Object process the caller's 
telephone number and verifies that it corresponds with the caller's PIN. If so t 
the Login Speech Object confirms the verification to the caller and returns to 
the program module it came from. If the caller does not login, or if the caller 
does not invoke the Login Speech Object, the Main Menu Speech Object 
transitions to the next state. Figure A3 depicts a Passcode Speech Object to 
retrieve a forgotten PIN. Figure A4 depicts a New Account Speech Object to 
establish a new account. 

The caller may at any time return to the Main Menu document by 
uttering an acceptable speech grammar (e.g. "Home"). The Main Menu 
document jumps directly to a second abbreviated greeting (SO_HomeMenu 
A6) to account for the caller's familiarly with the VUI Application and to avoid 
the caller having to retrace the same navigated path. At this conversation 
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VUI Application Pr ogram Mgdu jes 
VUI Application Main Menu Speech Object 

Referring to figure A1 , the Main Menu Speech Object comprises 
several component speech objects that transition either to other component 
speech objects within the Main Menu Speech Object or to other program 
module Speech Objects in the VUI Application. 

Upon entry into the Main Menu Speech Object, the caller is greeted 
and prompted to utter a personal identification code or service name 
associated with a particular program module Speech Object (SO_Pin/Service 
A1). Diagram A depicts several possible transitions depending upon the 
caller's utterance. The caller may utter a grammar associated with a 
particular Service-Database program module (e.g. "Traffic") or with one of 
several caller administrative program modules (e.g. "Login", "New Account", 
"Service Tips", "Forgot Passcode"). 

If the caller utters a speech grammar corresponding to a Service- 
Database, the Main Menu document confirms the caller's choice (e.g. 
SO_Traffic, SO_Stocks) while transitioning to the program module Speech 
Object associated with the Service- Database A5. The Login program module 
Speech Object ("Login Speech Object") is of particular significance and 
enables accessing and creating a private caller profile to effect the 
customization of preferences and/or settings for each caller. For instance, the 
caller may enter home or work addresses, telephone numbers and other 
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the desired item. To disambiguate, the program modules of the VUI 
Application engage the caller in a standard disambiguation dialog to remove 
the ambiguity. 

The VUI Application transitions to a disambiguation Speech Object 
when an ambiguity is detected. The first step is to convey the ambiguous 
items in a list to the caller. For example, the caller is first prompted that an 
ambiguity exists by conveying an appropriate prompt such as "Did you mean 
<item 1>, <item 2>, <item n> ...?" Further, the last item included in the list 
and conveyed to the caller is "none of the above" or a prompt with similar 
meaning. Then, selection of the desired item an,d navigation of the list by the 
caller is accomplished with appropriate utterance and speech grammar (e.g. 
"that one" or "previous item" & "the first one", respectively). Further, the 
Disambiguating Speech Object further creates dynamic speech grammars 
based upon the caller's utterance of a subset of each item to be 
disambiguated. For instance, in a Disambiguation Speech Object to 
determine a caller's actual desired New York airport, the Disambiguation 
Speech Object will prompt, "Did you mean, New York JFK, New York 
LaGuardia, Newark New Jersey, or none of these?" Both "New York, JFK" 
and "JFK" are acceptable utterances. Upon disambiguating the search items, 
the disambiguation dialog transitions to the next conversation state in the 
program module where the ambiguity arose. 
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"Stock Information Database") by vocalizing a recognized utterance that is 
enabled within the program module Speech Object. 

Standard Treatment of Muti-ltem Search Results 

Because it is the intention of some searches of the Service- Databases 
5 to return several information items, it becomes necessary to effectively 
present the information to the caller in a manner that permits the caller to 
select the desired item. Thus, the VUI Application presents the information 
items to the caller by engaging the caller in a List Speech Object. 

The List Speech Object comprises a preamble that will convey 
c acceptable speech grammars to navigate the list, the number of items in a 
muti-item list, and an audible separator that will alert the caller that the next 
item on the list will be conveyed and that the response period within which to 
select the previous item has passed. Both auto-advance and mandatory 
vocalized navigation modes are available methods of navigating a List 
. Speech Object. Further, selection of an item in the list or getting more 

information about an item in a list is accomplished by appropriate recognized 
speech grammars such as "that one" or "more details". 

Standard Treatment of Search Result Ambiguities 

Alternatively, there are circumstances when the user's utterance may 
be ambiguous to the VUI Application. Resolving the ambiguity, or 
disambiguation, in accordance with the present invention comprises a method 
of efficiently presenting the ambiguity to the caller and letting the caller select 
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Application through the API of the selected Service-Database to search for, 
retrieve, and convey the retrieved information to the Text-to-Speech and 
Media Server, which information is ultimately conveyed vocally to the caller 
through the Telephony Server. 

5 The presently preferred embodiment of the VUI Application is 

implemented in speech objects with the program modules being implemented 
in distinct program module Speech Objects that further comprise reused 
component speech objects and custom component Speech Objects. 
Additionally, although speech objects are mainly intended to evoke specific 
1 o recognized utterances from the caller, speech objects are also contemplated 
to be useful for conveying advertisements or other public and private 
information to the caller. The VUI Application and program module Speech 
Objects are more fully described below in the specification and the depicted 
conversational state diagrams. 

is VUI Application Universal Vocal Navigation 

In accordance with the VUI Application, and because specific universal 
grammar associated with the VUI Application Main Menu is available within 
each distinct Speech Object program module, the VUI Application also 
provides for Universal Navigation commands at any point in the caller's 
20 navigation. For example, at any point after establishing a VUI Application 
session, the caller may vocalize a primary specific navigable point or a 
Service-Database (e.g. "Traffic Conditions Database", "Home Menu", or 
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Object interface between the caller and the API of the independent Service- 
Database that is responsive to recognized spoken commands ("utterances") 
and further includes recorded vocal navigation prompts that are conveyed to 
the caller to aid the caller's retrieval of information from the Service- 
s Databases. Moreover, the VUI Application further comprises distinct program 
modules associated with each Service- Database that enable the employment 
of module specific speech objects and software code that is responsive to the 
caller's utterances ("speech grammars") that are particularly germane to the 
Service-Database. 

10 The presently preferred program modules of the VUI Application 

include: a Traffic Condition Module, a Business Finder Module, a Stock 
Information Module, a Driving Directions Module, a Flight Information Module, 
and a Weather Conditions Module. It is contemplated that additional program 
modules will be integrated with the VUI Application to service the demand for 

is additional vocally searchable Service-Databases. 

The Media Server comprises hardware under program control to store 
the recorded prompts associated with the Speech Object program modules of 
the VUI Application. The Media Server conveys speech objects to the 
Telephony Server according to the process flow of the VUI Application. The 
20 Speech Recognition Server comprises hardware under program control to 
interpret the caller's vocalized navigation commands for the VUI Application. 
Thereafter the VUI Application translates the caller's uttered Service- content 
requests into database search expressions that are passed by the VUI 



6 



WO 01/26350 PCT/US00/26935 

Speech Recognition Server, a Text-to- Speech Server, and a Media Server 
coupled to an Application Program Interface (API) of an independent Service- 
Database. The above mentioned components of the preferred embodiment 
are coupled together in a backbone network, and accordingly, each of the 
5 above components includes a network interface comprising hardware under 
program control to enable transceiving communications between the network 
components. The presently preferred backbone network comprises a TCP/IP 
network. Multiples of each of the above mentioned components can be 
incorporated together with a load-balancer for efficient handling of increased 
10 demand processing requirements. 

A caller connects to the Telephony Server by dialing a telephone 
number associated with the Telephony Server by a Public Switched 
Telephone Network (PSTN). The Telephony Server includes a Telephone 
Network interface for transceiving and managing phone calls received over a 

15 telephone network. Figure 1 depicts the Telephone Network Interface coupled 
to a Public Switched Telephone Network (PSTN) using T1 lines. The 
Telephone Network Interface further comprises speech signal processing 
hardware under program control for creating and outputting digitized speech- 
to-data streams and analog data-to-speech streams (collectively "speech- 

20 data-streams") that are conveyed to and from the Telephone Network 
Interface. 

The VUI Application Server comprises hardware under control of a VUI 
Application. The VUI Application implements a vocally navigable Speech 
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Business Finder Speech Object. 

R9 ' ° 2 ^! n C HL a , C0 7 erS f ti0n f' State dia 9 ram of a " embodiment of a 

extended funct.onal.ty of the Business Finder Speech Object. 

Fl9 ' 01 25^ #' co ™ ers f io ™* ^ate diagram of an embodiment of a 

Stock Information Speech Object. 

Fig. D2 Depicts a conversational state diagram of an embodiment of 

extended functionality of a Stock information Speech ObjeTt 

Fig. D3 Depicts a conversational state diagram of an embodiment of 

extended functionality of a Stock Information Speech Object 

Fi9 - E1 ttysssr 1 state dia9ram of an embodiment ° f a 

Fig. E2 Dep co ^sationa. state diagram of an embodiment of a 

caller ' conveying weather information to the 

Fig. F1 Depicts a conversational state diagram of an embodiment of a 

Address Locating Speech Object. "°aiment or a 

F * F2 £ s £;:r^ d c of - — - - ■ 

G1 F,^ °< « -^-nt of a 

Fi9 - G2 °^lto^sT^ o^ t dja9ram of an emb <~ - * 

Fi9 - G3 S; a sS e oS; al state dia9ram of an embodiment °< * 

Fi9 - H KfflK ^ct dia9ram of an emb ~ - * 



Pescription Of Preterm P^bodim^ 



in a 



The preferred embodiment of the present invention is implemented i 
scaleable system architecture that includes at least one each of the following; 
a Vocal User Interface (VUI) Applicat.on Server, a Telephony Server, a 
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be invoked to define the invention(s), the claims will specifically state the 
phrases "means for" or "step for" and a function, without also reciting in such 
phrases any structure, material, or act in support of the function. Even when 
the claims recite a "means for" or "step for" performing a function, if they also 
5 recite any structure, material or acts in support of that means of step, then the 
intention is not to invoke the provisions of 35 U.S.C. §112, paragraph 6. 
Moreover, even if the provisions of 35 U.S.C. §112, paragraph 6. are invoked 
to define the inventions, it is intended that the inventions not be limited only to 
the specific structure, material or acts that are described in the preferred 
10 embodiments, but in addition, include any and all structures, materials or acts 
that perform the claimed function, along with any and all known or later- 
developed equivalent structures, materials or acts for performing the claimed 
function. 

Brief Description o f the Drawing s 

Fig. A1 Depicts a conversational state diagram of an embodiment of a 

Main Menu Speech Object. 

Fig. A2 Depicts a conversational state diagram of an embodiment of a 

Login Speech Object. 

Fig. A3 Depicts a conversational state diagram of an embodiment of a 

New Account Speech Object. 

Fig. A4 Depicts a conversational state diagram of an embodiment of a 

Passcode Speech Object. 

Fig. B1 Depicts a conversational state diagram of an embodiment of a 

Traffic Condition Speech Object. 

Fig. B2 Depicts a conversational state diagram of an alternate 

embodiment of a Traffic Condition Speech Object. 

Fig. C1 Depicts a conversational state diagram of an embodiment of a 
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there ,s need tor user Wendy VU.s ,ha. „„, increase the ,ike,ihood lhat cal(ere 
will take advantage of the services. 

Summary nf the lnv^nti ?n 
The present invention comprises e VU, Speech Object A PP ,ice,ion 
, comprised o, pro 9ram modu,e speech objects tha, interface with the AP,s of 
service-databases ,o retrieve a ca„e,s desired information. Moreover 
inferentia. and educated decisions are made regarding a ca,,e,s desired 
information to enabie a more catier ,riend,y experience with the VU, Speech 
Object Application. 

The novo, features that are considered characteristic o, the invention 
are se, forth with padicuiamy in the appended Cairns. The invention Hset, 
however, both as to its structure and *s operation together with the addKiona, 
ob,ec. and advantages thereof wit, best be understood from the ,o„owing 
description of the preferred embodiment o, the present invention when read in 
> conjunct w*h the accompanying drawings. Untess specifics,* noted « is 
■mended tha, the words and phrases in the specification and Cairns be given 
the ordinary and accustomed meaning to those of ordinaty ski,, in the 
apptfcabie art or ads. „ any other meaning is intended, the specification wi„ 
specify state tha, a specie, meaning is being app,ied to a word or phrase 
Ukewise, the use o, the words -funcion- or "means- in the Description o, 
Preferred Embodiments is no, intended to indicate a desire to invoke the 
specie, provision o, 35 U.S.C. §112 , paragrapn 6 ,„ deflne ^ ^ 
•he contra,*, i, the provisions o, 35 U.S.C. §1 12 . paragraph 6. are sough, to 
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VOCAL INTERFACE SYSTEM AND METHOD 

Field of the Invention 
The present invention relates to the field of methods for enabling a caller to 
vocally access and retrieve information over a computer network. 

5 Background 

Customers have come to rely on and expect the quick availability of 
information from their merchants. Accordingly, merchants have devised 
methods of allowing their customers to have easy access to information about 
their products and services. The retrieval of information via merchant Internet 
o Web pages, has for example, experienced explosive growth. Moreover, the 
development of practical speech recognition hardware and software has now 
made it possible to allow customers to access merchant information with a 
vocal user interface (VUI). 

To date however, the development of effective or even tolerable VUls 
5 has lagged the development of the technology to implement VUls. This is the 
case because much of the communication between people in a typical 
conversation is nonverbal. This is particularly true when one individual is 
attempting to ascertain a specific item of information from the other. These 
conversations, when effective, are heavily influenced by educated and context 
o dependent inferential answers and prompts for more information to aid in 
pinpointing the particular information of interest. When these elements are 
missing from the conversation, VUI implementations tend to be cumbersome 
and unpleasant to use, and accordingly, frustrating to users. Accordingly, 



(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 
International Bureau 

(43) International Publication Date 
12 April 2001 (12.04.2001) 




PCT 



fllllllOIIIillllllillllllllDIIIillll 

(10) International Publication Number 

WO 01/26350 Al 



(51) International Patent Classification 7 : H04M 3/493 
3/50 



(21) International Application Number: PCT/US00/26935 

(22) International Filing Date: 

28 September 2000 (28.09.2000) 



(25) Filing Language: 

(26) Publication Language: 



English 
English 



(30) Priority Data: 
60/156,968 



1 October 1999 (01.10.1999) US 



(71) Applicant (for all designated States except US): BEVO- 
CAL, INC. [US/US]; 982 Walsh Avenue, 2nd Floor. Santa 
Clara, CA 95050 (US). 

(72) Inventors; and 

(75) Inventors/Applicants (for US only): BERNER, C, 
Mikael [US/US]; 984 Sherman Oaks Drive, San Jose, CA 
95128 (US). JOSHI, Arool, M. [US/US]; 449 Hawthorne 
Avenue, Apt. #4, Palo Alto, CA 94301 (US). GUERRA, 
Lisa, M. [US/US]; 1722-B Marshall Court, Los Altos. 
CA 94024 (US). STONE, Kevin, ML [US/US]; 965 E. El 
Camino Real #625, Sunnyvale, CA 94087 (US). TRAN, 



Steve, T. [US/US]; 449 Hawthorne Avenue, Apt. #4 Palo 
Alto, CA 94301 (US). 

(74) Agents: GLENN, Michael et al.; Glenn Patent Group. 
3475 Edison Way, Ste. L., Menlo Park, CA 94025 (US). 

(81) Designated States (nationalj: AE, AL, AM, AT, AU AZ, 
BA, BB, BG. BR, BY, CA, CH, CN, CR, CU, CZ, DE, DK 
DM, EE, ES, FI, GB, GD, GE, GH, GM, HR, HU, ID, IL,' 
IN, IS, JP, KE, KG, KP, KR. KZ, LC. LK, LR, LS, LT, LU, 
LV, MA, MD, MG, MK, MN, MW, MX, NO, NZ, PL, PT 
RO, RU, SD, SE, SG, SI. SK, SL, TJ, TM. TO, TT, TZ, UA* 
UG, US. UZ, VN, YU, ZA, ZW. 

(84) Designated States (regional): ARIPO patent (GH, GM 
KE, I^S, MW, MZ, SD, SL, SZ, TZ, UG, ZW), Eurasian' 
patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European 
patent (AT, BE, CH, CY, DE, DK, ES, FI, FR, GB. GR. IE, 
IT, LU, MC, NL, PT, SE), OAPI patent (BF, BJ, CF, CG 
O, CM, GA. GN, GW, ML. MR, NE, SN, TD, TG). 

Published: 

— With international search report. 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



m 
so 



(54) Title: VOCAL INTERFACE SYSTEM AND METHOD 

(57) Abstract: A VUI Speech Object Application comprised of program module 
service-databases to retrieve a caller's desired information. 



speech objects that interface with the APIs of 



